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THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, how^ever, may a reply be timety filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 29 October 2004 . 
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3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

Response to Amendment and Arguments 

1 . Applicant's amendment filed on October 29, 2004 has been entered and made of record. 

2. In view of applicant's amendment, the claim objections are withdrawn. 

3. Applicant's arguments have been fully considered, but they are not deemed to be 
persuasive for at least the following reasons. 

Applicants argue (pages 14-15) that their claimed invention (claims 1-4) differs from the 
prior art because ''Lu teaches using multiple capturing sections to perform image capturing and 
not a capturing section as claimed." The Examiner disagrees. Lu clearly discloses a single 
capturing section (40) to perform image capturing (col. 5, lines 44-55). 

Applicants further argue (page 15) that in Lu, "distances are not calculated and further, 
two or more images at one viewpoint and another image at another viewpoint are not used to 
calculate the depth." The Examiner disagrees. Lu discloses explains that the time series stereo 
images (two or more images at one view point and another image at another view point) are 
converted into "time series three-dimensional surfaces" (col. 7, lines 18-21). Note that the z- 
value of the "time series three-dimensional surfaces" provides depth information (col. 13, lines 
21-23). 

Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
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A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1, 2, 4, 5, 12 are rejected under 35 U.S.C. 102(b) as being anticipated by Lu, U.S. 
Patent No. 5,852,672 ("Lu"). 

Referring to claim 1 , Lu discloses an image capturing apparatus for obtaining information 
regarding a depth of a subject, comprising: 

a. a capturing section operable to perform image capturing for the subject at a 
plurality of viewpoints (col. 5, lines 30-55 and figure 2) 

b. a controller operable to control the capturing section to perform the image 
capturing at different timings at the plurality of viewpoints (col. 7, lines 12-25 and figure 6) 

c. the controller controls the capturing section to perform the image capturing for the 
subject two or more times at the at least one of the plurality of viewpoints (figure 6). 

Referring to claim 2, Lu further discloses that the capturing section includes a plurality of 
capturing units respectively provided at a plurality of different positions, and the controller 
controls the plurality of capturing units to successively perform the image capturing for the 
subject in such a manner that at least one of the capturing units performs the image capturing two 
or more times (figures 2 and 6). 

Referring to claim 4, Lu discloses an image capturing apparatus for obtaining information 
regarding a depth of a subject, comprising: 

a. a capturing section operable to perform image capturing for the subject at a 
plurality of viewpoints (col. 5, lines 30-55 and figure 2) 
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b. a controller operable to control the capturing section to perform the image 
capturing at different timings at the plurality of viewpoints (col. 7, lines 12-25 and figure 6) 

c. the controller controls the capturing section to perform the image capturing for the 
subject two or more times at the at least one of the plurality of viewpoints (figure 6) 

d. a depth calculating unit operable to calculate a depth of a particular region of the 
subject based on two or more images obtained by the image capturing performed for the subject 
two or more times at the one viewpoint and another image obtained by the image capturing 
performed at another viewpoint different from the one viewpoint [col. 7, lines 12-25. Note that 
the (two or more) time series images (figure 6) are used to obtain time series three-dimensional 
surfaces (depth) of the subject]. 

Referring to claim 5, Lu further discloses a positional difference detecting unit operable 
to detect a positional difference of an image of the particular region of the subject based on the 
two or more images obtained at the one view point and the other image obtained at the another 
view point, wherein the depth calculating unit calculates the depth of the particular region of the 
subject based on the positional difference [col. 6, line 25-col. 7, line 1 1. Lu explains that the 
depth information of the subject (z-coordinate) is calculated based on the detected positional 
difference (camera parameters) of the two or more images obtained at one view point and the 
other image obtained at the another view point]. 

Referring to claim 12, Lu further discloses that the capturing section includes the 
plurality of capturing units at three or more viewpoints which are not aligned on one line (figure 
1). 
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Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 3, 8 10, 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Lu, U.S. Patent No. 5,852,672 ("Lu") and Bacs, Jr. et al., U.S. Patent No. 
6,324,347 ("Bacs"). 

Referring to claim 3, Lu does not explicitly disclose a viewpoint moving system operable 
to move a position at which the capturing section performs the image capturing for the subject to 
the plurality of viewpoints. However, this feature was exceedingly well known in the art. For 
example, Bacs discloses a viewpoint moving system operable to move a position at which a 
capturing section performs image capturing for a subject to a plurality of viewpoints, and a 
controller for controlling a capturing section to perform image capturing for the subject at a 
plurality of viewpoints successively by moving the position to the plurality of view points (col. 
3, lines 23-40 and figure 1). 

Lu and Bacs are combinable because they are both concerned with stereo imaging 
systems. At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to modify the image capturing apparatus of Lu to include the viev^oint moving system of 
Bacs. The suggestion/motivation for doing so would have been to provide an imaging system 
that is compact in size, light weight, efficient in construction and operation, and convenient to 
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implement in conventional video cameras (Bacs, col. 3, lines 17-22). Therefore, it would have 
been obvious to combine Lu with Bacs to obtain the invention as specified in claim 3. 

Referring to claim 8, Bacs further discloses an image capturing section that includes a 
light converging unit operable to converge light incident thereon and a light-limiting unit having 
at least aperture for limiting a range where the light is allowed to pass, and a viewpoint moving 
unit that moves the aperture by moving the light-limiting unit, to realize a plurality of viewpoints 
(col. 3, lines 23-40 and figure 1). 

Referring to claim 10, Bacs further discloses that the viewpoint moving unit is capable of 
moving the capturing section at three or more viev^oints which are not aligned on one line (col. 
6, lines 7-28 and figures 1 and 6). 

Referring to claim 1 1 , Bacs further discloses that the viev^oint moving unit is capable of 
moving the capturing section to a variety of different positions (col. 6, lines 7-28 and figures 1 
and 6). 

Lu and Bacs do not explicitly disclose that the capturing section is moved to five 
positions including apices and a center of a diamond. However, the Examiner notes that the 
specific pattern of the positions where the capturing section is moved to is not considered a 
patentable distinction because it would have been chosen by the user during experimentation in 
order to meet his/her requirements. Furthermore, Bacs states that "a variety of configurations 
ranging from circular to rectangular to complex lissajous patterns" may be implemented (Bacs, 
col. 4, lines 4-7). Therefore, it would have been obvious to move the capturing section of Lu and 
Bacs to five positions including apices and a center of a diamond. The suggestion/motivation for 
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doing so would have been to increase the flexibility of the system by providing a variety of 
different image capturing configurations. 

6. Claim 9 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of 
Lu, U.S. Patent No. 5,852,672 ("Lu"), Bacs, Jr. et al., U.S. Patent No. 6,324,347 ("Bacs"), and 
Lo et al., U.S. Patent No. 6,269,223 ("Lo"). 

Lu and Bacs do not explicitly disclose that the capturing section includes a light-limiting 
unit having a plurality of apertures for limiting a range where light is allowed to pass, and that 
the viewpoint moving unit closes at least one of the plurality of apertures to realize the plurality 
of viewpoints. 

Lo discloses an image capturing system that includes a light-limiting unit having a 
plurality of apertures for limiting a range where light is allowed to pass, and a viewpoint moving 
unit that closes at least one of the plurality of apertures to realize the plurality of viewpoints (col. 
2, lines 13-37). 

Lu, Bacs, and Lo are combinable because they are all concerned with stereo imaging 
systems. At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to modify the image capturing system of Lu and Bacs, so that it includes the features 
taught by Lo. The suggestion/motivation for doing so would have been to provide a camera that 
is simple in design and capable of taking both mono and stereo images (Lo, col. 1, line 65-coL 2, 
line 1 1). Therefore, it would have been obvious to combine Lu and Bacs with Lo to obtain the 
invention as specified in claim 9. 
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7. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lu, U.S. Patent 
No. 5,852,672 ("Lu"). 

Referring to claim 13, Lu does not explicitly disclose that the capturing section includes 
the plurality of capturing units at five positions including apices and a center of a diamond. 
However, the Examiner notes that the specific pattern of the positions of the capturing devices is 
not considered a patentable distinction because it would have been chosen by the user during 
experimentation in order to meet his/her requirements. Furthermore, Lu explains that a variety 
of different position patterns for the capturing devices can be implemented (see figure 1 and 2). 
Therefore, it would have been obvious to set the plurality of capturing units at five positions 
including apices and a center of a diamond. The suggestion/motivation for doing so would have 
been to increase the flexibility of the system by providing a variety of position patterns for the 
image capturing devices. 

8. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Lu, U.S. Patent No. 5,852,672 ("Lu") and Moreton et al., U.S. Patent No. 5,835,133 
("Moreton"). 

Referring to claim 14, Lu does not explicitly disclose that the controller controls the 
capturing section to alternately perform the image capturing at two viewpoints three or more 
times. However, this feature was exceedingly well known in the art. For example, Moreton 
discloses a controller that controls a capturing section to alternately perform image capturing at 
two viewpoints three or more times (col. 8, lines 1-29). 
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Lu and Moreton are combinable because they are both concerned with stereo imaging 
systems. At the time of the invention, it would have been obvious to a person of ordinary skill 
in the art to modify the controller of Lu so that it controls the capturing section to alternately 
perform the image capturing at two viewpoints three or more times, as taught by Moreton. The 
suggestion/motivation for doing so would have been to enhance the imaging process by 
providing the capability of high resolution image generation (Moreton, col. 8, lines 30-32). 
Therefore, it would have been obvious to combine Lu with Moreton to obtain the invention as 
specified in claim 14. 

Allowable Subject Matter 

9. Claims 6 and 7 are objected to as being dependent upon a rejected base claim, but would 
be allowable if rewritten in independent form including all of the limitations of the base claim 
and any intervening claims. 

1 0. Claims 1 5-22 are allowed. 

Conclusion 

1 1 . Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
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MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 1 36(a) will be calculated fi-om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Charles Kim whose telephone number is 703-306-4038. The 
examiner can normally be reached on Mon thru Thurs 8:30am to 6pm and alternating Fri 9:30am 
to 6pm, 

If attempts to reach the examiner by telephone are unsuccessftil, the examiner's 
supervisor, Amelia Au can be reached on 703-308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



February 23, 2005 




Primary Examiner 



